課程資訊
課程名稱
動態規劃與應用
Dynamic Programming 
開課學期
109-2 
授課對象
工學院  工業工程學研究所  
授課教師
吳政鴻 
課號
IE5038 
課程識別碼
546EU6080 
班次
 
學分
3.0 
全/半年
半年 
必/選修
選修 
上課時間
星期一6,7,8(13:20~16:20) 
上課地點
國青101 
備註
本課程以英語授課。
總人數上限:35人 
Ceiba 課程網頁
http://ceiba.ntu.edu.tw/1092DP 
課程簡介影片
 
核心能力關聯
核心能力與課程規劃關聯圖
課程大綱
為確保您我的權利,請尊重智慧財產權及不得非法影印
課程概述

This course emphasizes the use of stochastic dynamic optimization methods in theory and practice. General knowledge of probability theory and stochastic processes is assumed. Applications considered include revenue management, queueing systems and supply chain systems. The topics discussed also have wide applications to financial, economic, and engineering systems.  

課程目標
-Solve problems in which sequential decision making is an issue.
-Understand the Principle of Optimality.
-Know how to include randomness in sequential decision-making processes.
-Construct and Solve infinite-horizon Markov decision problems.
-Show the existence of optimal policy structure for a wide variety of dynamic optimization problems
-Introduction to Stochastic Programming 
課程要求
Background in the college-level mathematical analysis, probability theory, and stochastic processes is required. In addition, homework and term project will include developing computer codes for algorithms discussed in class. These computer codes will be applied to solve stochastic dynamic decision problems in practice. 
預期每週課後學習時數
 
Office Hours
另約時間 
指定閱讀
There will be no required textbook for this course; required reading materials will be distributed either in class or through the course web page.

There are many good textbooks on dynamic programming, however, most of them are much more extensive than what we could cover in this semester. These textbooks differ slightly in their emphasis and presentation; I am providing references to some of them for you to use as reference materials. 
參考書目
- E. Denardo, Dynamic Programming: Models and Applications, 1982
- M. L. Puterman, Markov Decision Processes, Wiley, 1994
- L. I. Sennott, Stochastic Dynamic Programming and the Control of Queueing
Systems, Wiley, 1999
- J. R. Birge and F. Louveaux, Introduction to Stochastic Programming,
Springer, 1997
- S. G. Nash and A. Sofer, Linear and Nonlinear Programming, McGraw-Hill, 1996
- D. P. Bertsekas, Dynamic Programming and Optimal Control, 2nd edition, Athena
Scientific, 2001
- V. G. Kulkarni, Modeling and Analysis of Stochastic Systems, Chapman &
Hall,1995
- S. M. Ross, Introduction to Probability Models, 8th edition, Academic Press,
2002 S. M. Ross, Stochastic Processes, 2nd edition, Wiley, 1995
- S. Resnick, Adventure in Stochastic Processes, 1st edition, Birkhauser, 1992
- S. Karlin and H. E. Taylor, A First Course in Stochastic Processes, 2nd
edition, Academic Presses, 1975 
評量方式
(僅供參考)
 
No.
項目
百分比
說明
1. 
Projects, Discussion, and Reports 
15% 
 
2. 
1st Midterm Exam 
30% 
 
3. 
2nd Midterm Exam 
35% 
 
4. 
Quizzes and Homework 
20% 
 
 
課程進度
週次
日期
單元主題